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Abstract 

Let / be a {0, l}-valued function over an integer d-dimensional cube {0,1,..., n — l} d , 
for n > 2 and d > 1. The function / is called threshold if there exists a hyperplane 
which separates 0-valued points from 1-valued points. Let C be a class of functions and 
/ € C. A point x is essential for the function / with respect to C if there exists a 
function g £ C such that a; is a unique point on which / differs from g. A set of points 
X is called teaching for the function / with respect to C if no function in C\ {/} agrees 
with / on X. It is known that any threshold function has a unique minimal teaching 
set, which coincides with the set of its essential points. In this paper we study teaching 
sets of fc-threshold functions, i.e. functions that can be represented as a conjunction of 
k threshold functions. We reveal a connection between essential points of k threshold 
functions and essential points of the corresponding fc-threshold function. We note that, 
in general, a fc-threshold function is not specified by its essential points and can have 
more than one minimal teaching set. We show that for d = 2 the number of minimal 
teaching sets for a 2-threshold function can grow as fl(n 2 ). We also consider the class of 
polytopes with vertices in the d-dimensional cube. Each polytope from this class can be 
defined by a fc-threshold function for some fc. In terms of fc-threshold functions we prove 
that a polytope with vertices in the d-dimensional cube has a unique minimal teaching 
set which is equal to the set of its essential points. For d = 2 we describe structure of the 
minimal teaching set of a polytope and show that cardinality of this set is either 0(n 2 ) 
or 0(n) and depends on the perimeter and the minimum angle of the polytope. 

Keywords: machine learning, threshold function, essential point, teaching set, learning 
complexity, fc-threshold function 


1. Introduction 


Let n and d be integers such that n > 2 and d > 1 and let E d denote a d-dimensional 
cube {0,1,..., n — l} d . A function / that maps E d to {0,1} is threshold , if there exist 
real numbers ao, ai,..., ay. such that 


Mi(f) 



d | 

^ E n '■ 'y ^ a j x j — a o / 
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d 

where M v (f) is the set of points x £ E% for which f(x) = u. The inequality ^ ajXj < a o 

i — 1 

is called threshold. We denote by T (d,n) the class of all threshold functions over E 
Let k be a natural number. A function / that maps to {0,1} is called k-threshold 
if there exist real numbers oio, an,..., akd. such that 


Mi(f) 



d \ 

£ ^ n ' ^ x j — a^o, i — 1,..., A. / 

i = 1 J 


( 1 ) 


d 

The system of inequalities Yh a ij x 3 — a w, i = 1,..., k is called threshold and defines 

3 =i 

the Ac-threshold function /. Let T (d,n,k) be the class of fc-threshold functions over E%. 
By definition T (d,n, 1) = T (d,n). Note that a fc-threshold function is also a j-thresholcl 
function for j > k. Denote by T (d, n, *) the class of all fc-threshold functions over Ef t for 
all natural k, that is X(d, n, *) = (J T(d, n, k). 

k> 1 

For any fc-threshold function / there exist threshold functions f\..... fk such that 

f{x) = fi(x) A •• • A f k (x), 

where ”A” denotes the usual logical conjunction. We will say that / is defined by 
A, • • •, fk and {/i, is defining set for /. 

A convex hull of a set of points X C is denoted by Conv(A). For a function / : 
En —> {0,1} we denote by P(f) the convex hull of Mi(/), that is P(f) = Conv(Mi(/)). 
For any polytope P with vertices in Ef t there exists a unique /c-threshold function /, 
such that P = P{f). Therefore there is one-to-one correspondence between functions in 
the class T (d, n, *) and polytopes with vertices in E%, and we can say that T(d, n, *) is a 
class of polytopes with vertices in E%. 

In pQ Angluin considered a model of concept learning with membership queries. In 
this model a domain X and a concept class S C 2 X are known to both the learner (or 
learning algorithm) and the oracle. The goal of the learner is to identify an unknown 
target concept St £ S that has been fixed by the oracle. To this end, the learner may ask 
the oracle membership queries “does an element x belong to Sr?”, to which the oracle 
returns “yes” or “no”. The learning complexity of a learning algorithm A with respect 
to a concept class S is the minimum number of membership queries sufficient for A to 
identify any concept in S. The learning complexity of a concept class S is defined as the 
minimum learning complexity of a learning algorithm with respect to S over all learning 
algorithms which learn S using membership queries. 

In terms of Angluin’s model, a {0, l}-valued functions over E% can be considered as 
a characteristic functions of concepts. Here E ^ is the domain and a function / : E% —> 
{0,1} defines a concept M 1 (f). Concept learning with membership queries for classes of 
threshold functions, /c-threshold functions, and polytopes with vertices in E% corresponds 
to the problem of identifying geometric objects in E'f with certain properties. 

From results of [2] and [TTj it follows that the learning complexity of the class of 

threshold functions T (d,n) is O y)- In 0] Maass and Bultman studied learn¬ 

ing complexity of the class k-HALFSPACE where 0 < p < f. The class k- 
HALFSPACESf p is the subclass of fc-threshold functions over E% with restrictions 
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that for any / in this subclass P(f) has edges with length at least 16 • 


1 

p 


and an angle 


a between a pair of adjacent edges satisfies p < a < it — p. The learning algorithm 
proposed in [3] for identihcation a function / in k-HALFSPACE S' 2 requires a vertex 
of the polygon P(f) as input and uses 0(k(^ +logn)) membership queries. 

Let C be a class of {0, l}-valued functions over the domain X and / £ C. A teaching 
set of a function / with respect to C is a set of points TCI such that the only function 
in C which agrees with / on T is / itself. A teaching set T is minimal if no of its 
proper subset is teaching for /. Note that a teaching set of a function / £ 1(d, n, k) 
with respect to 1(d,n,*) is a teaching set with respect to T (d,n,k). A point i C I is 
called essential for a function / £ C with respect to C if there exists a function g £ C 
such that f(x) ^ g(x) and / agrees with g on A' \ {x}. Let us denote the set of essential 
points of a function / with respect to a class C by S(f,C) or by S(f) when C is clear. 
Let S v (f) = S(f) n By J(f, C) we denote the number of minimal teaching sets 

of a function / with respect to a class C and by <r(f, C) the minimum cardinality of a 
teaching set of / with respect to C. The teaching dimension of a class C is defined as 


o'(C) = ma xcr(f,C). 

The main aim of a learning algorithm with membership queries is to find any teaching 
set of a target function / with respect to a concept class C. The algorithm succeeds if it 
asked queries in all points of some teaching set of the function. Therefore the teaching 
dimension of the class C is a lower bound on the learning complexity of this class. 

It is known (see, for example, [5] and [B]), that the set of essential points of a threshold 
function is a teaching set of this function. Together with the simple observation that any 
teaching set of a function should contains all its essential points, this imply that any 
threshold function have a unique minimal teaching set, that is J(f,1(d,n)) = 1. In 
addition, it follows from that for any fixed d > 2 

a(1(d, n)) = 0 (log 2 _2 n) (n —> oo). 


In this paper we study combinatorial and structural properties of teaching sets of 
fc-threshold functions for k > 2. In particular, we show that 2-threshold functions from 
T(2, n, 2), in contrast with threshold functions, can have more than one minimal teaching 
set with respect to '1(2,n, 2). Moreover, we construct a sequence of functions from 
T(2, n, 2) for which number of minimal teaching sets grows as fl(n 2 ). On the other hand, 
we show that any fc-threshold function / (or a polytope with vertices in E%) has a unique 
minimal teaching set with respect to 1(d, n, *) coinciding with the set of essential points 
of / with respect to 1(d, n, *). In addition, we give a general description of minimal 
teaching sets of such functions. For functions in 1(2, n, *) we refine the given structure 
and derive a bound on the cardinality of the minimal teaching sets. 

The organization of the paper is as follows. In Section 2, we consider essential points 
of an fc-fold conjunction of an arbitrary {0, l}-valued functions f\,, fk and their con¬ 
nection with essential points of these functions. In the beginning of Section 3 we show 
that in general a /c-threshold function can have more than one minimal teaching set. 
The main result of Subsection 3.1 (Theorem [8]) states that a minimal teaching set of a k- 
threshold function with respect to 1(d, n, *) is unique and coincides with S(f, 1(d, n, *)). 
The structure of S(f,1(d,n , *)) is given as well. In Subsection 3.2 we consider the class 
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T(2, n, *) and for a function / in the class we prove an upper bound on the cardinality of 
S(f, T(2, n, *)). Finally, in Subsection 3.3 we consider functions in X(2, n, 2) with special 
properties and show that each of these functions has a minimal teaching set with cardi¬ 
nality at most 9 and there are functions with Q(n 2 ) minimal teaching sets with respect 
to X(2, n, 2). 

2. The set of essential points of a {0, l}-valued functions conjunction 

Since a fc-threshold function is a conjunction of k threshold functions, it is interesting 
to investigate connection between essential points of threshold functions fi,, f). and 
essential points of their conjunction. In this section we prove several propositions that 
establish this relationship. For a natural k > 1 and a class C of {0, l}-valued functions we 
denote by C k the class of functions which can be presented as conjunction of k functions 
from C. 

Proposition 1. Let C be a class of{ 0, 1}-valued functions over a domain X and /i,..., fk G 
C. Then for the function f = /i A • • • A fk the following inclusions hold: 

Si(fi,C) n Mi(/) C &(/,<*) (* = 1. k). 

Proof. Let x € Si(f i ,C)C\M 1 (f) for some i G {1,..., k}. Since x is an essential point of 
fi and fi(x ) = 1, there exists a function /' G C which differs from fi in the unique point 
x. Denote by f the conjunction /j A ... A /;_ i A f[ A /,+1 A ... A fk- The function /' 
belongs to the class C k and differs from / in the unique point x, namely f'{x) = 0 ^ f(x). 

It means that x is essential for /, i.e. x G Si(f,C k ). m 

Proposition 2. Let C be a class of{ 0, 1}-valued functions over a domain X and f ±,..., fk G 
C. Then for the function f = /i A • • • A fk the following inclusions hold: 

So(fi,C) n fl_c So{f,C k ) (i = l,...,k). 

Proof. Let x € So(fi,C ) n fj M\(fj) for some i G {1,..., k}. Since x € So(fi), there 

exists a function /' G C such that f[{x) = 1 and f[{y) = fi{y) for every y G X \ {x}. 
Denote by f the conjunction /i A ... A /,_ i A f[ A fi + \ A ... A fk- The function /' belongs 
to the class C k and, since x G fj Mi(fj), it differs from / in the unique point x, namely 

iA* 

f'{x) — 1 ^ /( x). Therefore x is essential for / and x G So(f,C k ). m 

Proposition 3. LetC be a class of {0,1 }-valued functions over a domain X and f G C k ' . 

If there exists a unique set fi,.. ■, fk G C such that f = fi A • • • A fk, then 

S(fi,C) C P)M 1 (/ J ) (i = l,...,k). 

Proof. Suppose to the contrary that there exists x G X such that x G S(fi,C) and 
fj{x) = 0 for some distinct indices i,j G {1,..., k}. It means that f(x) = 0. Since x is 
essential for fi, there exists a function /' G C which differs from fi in the unique point 
x. Clearly, fi A ... A i A /' A fi+\ A ... A fk = f, which contradicts the uniqueness of 
the set {/i,... ,/fc}. ■ 
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Corollary 4. Let C be a class of {0,1 }-valued functions over a domain X and f £ C k . 
If there exists a unique set fi,- ■ ■, fk 6C such that f = /i A • ■ ■ A fk then 


k 

U S v (fi,C)QS v {f,C k ) (I/ = 0,1). 

i =1 

Proof. Since the function / satisfies the conditions of Proposition |3j 

Si(fi,C) C M,(f) (i = l,...,fc) 

and 

By Propositions [l] and [2] we get 

k 

u sMnC) c sM,c k ). 

»=i 


3. Teaching sets of fc-threshold functions 

Recall that the minimal teaching set of a threshold function is unique and equal to 
the set of its essential points. The situation becomes different for fc-threshold functions 
when fc > 2. We illustrate this difference in the following example. 

Example 5. Let f be a function from X(2,4, 2) with 

M\{f) = {(1,2), (1,3), (2,2), (2,3)}. 

The set of essential points S(f) is 

{(1,1), (1,2), (2,1), (2, 2), (0,3), (3, 3)}. 

This set is not a teaching set because there exists a function g £ X(2,4, 2) with M\(g) = 
{(1, 2), (2,2)}, which agrees with f on S(f) (see Fig. [7p. Though if we add any of the 
two points (1, 3) or (2, 3) to S(f), then we get a minimal teaching set of the function f 
(see Fig. [1|) with respect to X(2,4, 2), and therefore J(f, T(2,4, 2)) > 2. 


3.1. Teaching sets for functions in X(d, n, *) 

In this section we prove that for fc > 2 and d > 2 the teaching dimension of X (d, n, fc) 
is n d . Then we consider the class X(d, n, *) and show that for a function / £ %(d,n,*) 
the set of its essential points with respect to X(d, n, *) is also a teaching set, and therefore 
it is a unique minimal teaching set of / with respect to X (d, n, *). 

Lemma 6. Let f : E d {0,1} be a function such that 1 < |Vert(P(/))| < 2 and 
P{f) H M 0 (f) = 0. Then f £ X(d, n, fc) for any fc > 2. 
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Figure 1: The stars denote the essential points. The black elements denote the points from The 

empty elements denote the points from Mo(/). The functions / (left plot) and g (right plot) agree on 

S(f). 


x 2 x 2 




Figure 2: The stars denote the points of the minimal teaching sets S(f) U{1, 3} (left plot) and S(/)U{2, 3} 
(right plot). 
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Proof. It is sufficient to show that / is a 2-threshold function. Let x and y be the two 
vertices of P{f). Note that if \Mi(f)\ = 1, then x = y. 

Clearly, it is possible to choose two parallel hyperplanes H' and H" sufficiently close 
to each other such that E d DH' = {x}, E d n H" = {y}, and there are no points between 
H' and H" in E~\M\{f). These hyperplanes can be used to define a 2-threshold function, 
that coincides with /. ■ 

In |[T] it was established that the teaching dimension of a class containing the empty 
set and N singleton sets is at least N. This result and Lemma [6] give us the teaching 
dimension for T (d, n, k), where k > 2: 

Corollary 7. er(T(d, n, &)) = n d for every k> 2. 

For a polytope P denote by Vert(P) the set of vertices of P, by B(P) the set of 
integer points on the border of P and by Int(P) the set of internal integer points of P. 
For / £ T (d,n,*) denote by D{f) the set (a: £ M 0 (/) : Conv(P(/)U{x})nM 0 (/) = {a:}}. 


Theorem 8. Let f £ T(<i, n, *), d > 2, n > 2. Then 


S(f, X(d, n, *)) 


E d n , M 1 (/)=0; 

Vert(P(/)) U D(f), M x {f) £ 0; 


and S(f, c I(d,n , *)) is a unique minimal teaching set of f. 

Proof. If M\{f) = 0, then / = 0, and therefore S(f) = E d . Clearly, in this case S(f) is 
a unique minimal teaching set for /. 

Now let Mi(/) ytz 0. We split the proof of this case into two parts. At first we show 
that all points from Vert(P(/)) U D(f) are essential, and then we prove that this set is 
a unique minimal teaching set. 

1. Let /' : E d —» {0,1} be a function which differs from / in a unique point x £ 
Vert (P(/)). Obviously P(f) fl M 0 (f) = 0 and f belongs to T(d, n, *). Therefore 
x is essential for / with respect to T (d, n, *). Now let /' : E d —> {0,1} be a function 
which differs from / in a unique point x £ D(f). The choice of x implies that the 
function f belongs to T (d, n, *) and hence x is essential point of / with respect to 
~(d, n, *). 

2. Since / belongs to the class T(d, n, *), knowing values of the function in Vert(P(/)) 
is sufficient to recover / in M\{f). Further, for every point x £ Mo(/) such that 
|Conv(P(/) U {x}) PI M 0 (f) | > 1 the set Conv(P(/) U {x}) n M 0 (f) necessarily 
contains at least one point from D(f). Therefore, to recover / in Mo(/) it is 
sufficient to know the function values in points from D(f) and Vert(P(/)). This 
leads us to a conclusion that Vert(P(/)) U D{f) is a teaching set. Moreover, since 
all points in this set are essential and any teaching set contains all essential points, 
we conclude that Vert(P(/)) UD(f) is a unique minimal teaching set and coincides 
with S(f). 


Lemma 9. Let f £ %(d,n,k),d > 2,fc > 2 and Mi(f) = {x'|. Then 

S(f,Z(d,n,k)) = {x 1 } U{xeE d : GCD(|xr - ®i|,..., \x d - x' d \) = 1}, 
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and S(f,1(d,n,k)) is a unique teaching set of f with respect to 1(d,n,k) and 

\S(f,1(d,n,k))\=G(n d ). 

Proof. 

Let S = {x £ E d : GCD(|aq — Xi\,. , \xd — x' d \) = 1}. For any x £ S the segment 
x'x does not contain other points from E d except x and x', that is x'x fl E d = {x',x}. 
Then, according to Lemma [6j a function g : E d —► {0, 1} with Mi(g) = {x',x} belongs 
to the class 1(d,n,k) for any k > 2. Since x distinguishes g from /, it is an essential 
point for the both functions. Therefore all points of S are essential for /. On the other 
hand, S U {a/} is a teaching set for / because for any point y £ E d \ {S U {a;'}} there 
exists a point y' £ S such that y,y',x' are collinear and y' is between y and x'. 

Let tp(i) be the Euler totient function. It is well known (see, for example, [9j) that 

tp(i) = —^n 2 + O(nlnn). 

i<n 

Using this formula we can get a lower bound on the cardinality of the minimal teaching 
set: 


\S U {a/}| = |{x = {x 1 ,...,x d ) € E d : GCD(|xi - a^|,. .., \x d - x' d \) = 1}| + 1 > 

> |{a: = (xi,. .. ,x d ) e E d : x 3 = ■ ■ ■ = x d = 0,GCD(|a;i - a^l, \x 2 - x' 2 \) = 1}| n d ~ 2 > 



Since \E d \ = n d , this lower bound matches a trivial upper bound, and therefore 
|5(/,T(d,n,fc))| = 0(n d ). ■ 

3.2. Teaching sets of functions in T(2,n, *) 

In the previous section we proved that for a function from T (d, n,*),d> 2 the set of 
its essential points is also the unique minimal teaching set. In this section we consider 
the class T(2, n, *) and describe the structure of the set of essential points for a function 
in this class. We also give an upper bound on the cardinality of this set. 

Let us consider an arbitrary function / £ ‘1(2, n,*). Note that P(f) can be the 
empty set, a point, a segment or a polygon. Let P(f) be a segment or a polygon, that is 
|Mi(/)| > 1, and let aiX\+a 2 X 2 = ao be the edge equality for an edge e of P(f). Without 
loss of generality we may assume that GCD(ai,a 2 ) = 1. Denote by edge inequality for 
edge e inequality a±Xi + a 2 x 2 < ao or/and a\X\ + a 2 x 2 > a o if it is true for all points 
of P(f). Note that if P(f) is a segment, then it has one edge but two edge inequalities 
corresponding to the edge. If P(f) is a polygon, then it has exactly one edge inequality 
for each edge. Hence the number of edge inequalities for P(f) is equal to the number of 
its vertices. 

Let / be a function from 1(2, n,*) with | Mi(f)\ > 1 and let 

a* 1 X 1 + a i2 x 2 < a M , i = 1,..., |Vert(P(/))| 
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be edge inequalities for P{f). The extended edge inequality for an edge e of P(f) is 
a\X\ + 020:2 < ag + 1, where a\Xi + 02 X 2 < a-o is the corresponding edge inequality for 
e. By P'(f) we denote the following extension of P(f) 

{x = (x l ,x 2 ) ■■ a a xi + a i2 x 2 < a i0 + 1, i = 1,..., |Vert(P(/))|}. (2) 


We also let 

A P(f) = P'(f)\P(f). 

It follows from the definition that P'(f) contains P(f), and for every straight line V 
containing an edge of P'(f) there exists an edge in P(f) belonging to the closest parallel 
to the V straight line which contains integer points. 

If P is a polygon then denote by V{P) the perimeter of P, by S(P) the area of P 
and by q m i n (P) the minimum angle between neighboring edges of P. 

The next proposition uses the Pick’s formula (see [TO]) for the area of a convex polygon 
P with integer vertices: 

S(P) = Int(P) + W- - 1. 

Proposition 10. Let f £ 1(2, n, *) and S(P(f)) > 0. Then D(f) = AP(f) C\M 0 (f). 


Proof. Note that by construction all integer points of A P(f) lie on the border of 
P'(f), which implies that A P(f) (~l M 0 (f) C D(f). Consider x = (xi,X 2 ) such that 
|Conv(P(/))U{x})nM 0 (/)| = 1 . To show that x £ A P(f) it is sufficient to prove that x is 
a solution of the system of inequalities Q, that is each extended edge inequality for P(f) 
holds true for x. Obviously, if an edge inequality is true for x, then the corresponding 
extended edge inequality is also true. Let e be the edge whose edge inequality is false 
for x, that is aiXi + 02X2 > a o- All integer points of the triangle Tr = Conv(e U {x}) 
belongs to eU{x}. Since Tr has integer vertices, its area can be calculated by the Pick’s 
formula: 

_ l( eU (x}) n ^| ! _ |e O E%\ - 1 

S(Tr) - - 1 - - . 

Comparing resulting equation with the classical triangle area formula S(Tr) 
conclude that 

t _ \ePEl\-l 

n ‘ x ~ u \ ’ 

1(e) 

where h x is the distance between point x and the line containing e. 

Now consider an integer point y = ( 2 / 1 , 2 / 2 ) for which aiyi + 02^2 = ao + 1. Using the 
same arguments it is easy to show that 


l(e)hj; 


we 


h 


v 


I e n Pn | — 1 

1(e) 


Hence, x and all integer points of the line aij/i + 0 , 21/2 = ao + 1 have the same distance 
to the line containing e. It means that aiXi + 02 X 2 = ao + 1, that is the extended edge 
inequality for e is true for x and x belongs to P(f), therefore D(f) C A P(f) fl M 0 (f). 
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Corollary 11. Let f £ 1(2 , n, *) and S(P(f)) > 0. Then 

S(f,1(2,n,*)) = (AP(/)nM 0 (/))UVert(P(/)). 

The next lemma establishes relationship between the perimeters of P(/) and P'(f) 
to help us to estimate the cardinality of the set of essential points of a function from 
£(2 


Lemma 12. Let f £ 1(2,n,*) and S(P(f)) > 0. Then 

|Vert(P(/))| 

V(P'(f))<V(P(f)) + 2 £ cot 


2 


where qi(P(f)) for i £ {1,..., |Vert(P(/))|} are the angles between neighboring edges of 

P(f)- 


Proof. Denote by P" the set of points satisfying such a condition that if an edge 
inequality is false for a point, then the distance between the point and the straight line 
containing the corresponding edge is at most 1. Note that points of P'(f ) also satisfy 
the specified condition, so P'(f) C P" and, consequently, V(P'(f)) < V(P") (see Fig. 
[3]). Further, P" is a convex polygon with |Vert(P(/))| vertices, and each edge e" of P" 
is parallel to some edge e of P(f) and is at distance 1 from the line containing e. Let 
q i} q i+ 1 for some i £ {1,..., |Vert(P(/))| — 1} be the angles between e and its neighboring 
edges in P(/). By construction of P" we have: 

l(e ") = 1(e) + cot ^ + cot 

Summing up the lengths of all edges of P" we have: 


|Vert(P(/))| 

V(P'(f))<V(P")=V(P(f)) + 2 £ cot 

1=1 


<h(P(f)) 

2 


Theorem 13. Let f £ 1(2, n, *) and S(P(f)) > 0. Then 


\S(f,1(2,n, *))| = O ( min ( n,V(P(f)) 


q m in(P(f )) 


Proof. 

By Corollary 11 we have S(f,1(2,n,*)) = (A P(f) fl M 0 (/)) U Vert(P(/)). Since 
every point of S(f,1(2,n,*)) is integer and either belongs to the border of P(f) or to 
the border of P 7 (/), the cardinality of S(f, 1(2, n, *)) can be bounded from above by the 
sum of the perimeters V(P(f)) and V(P'(f)). So we have: 


\S(f,1(2,n,*))\<V(P(f)) + V(P'(f))<2P(P(f)) + 


|Vert(P(/))| 

2 cot 

i=1 


Qi(P(f)) 

2 
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where q t for i £ {1,..., |Vert(P(/))|} are the angles between neighboring edges of P(/). 

As the number of integer vertices of a convex polygon is not more than the perimeter 
of the polygon, we have |Vert(P(/))| < P(P(/)). Obviously, only 2 angles of a convex 
polygon can be less than Therefore 


2 P(P(/)) + 


|Vert(P(/))| 

2 cot 

i—1 


2 


< 


< 2P(P(/)) + 4cot gmm ^ (/) ) + V3(V(P(f)) - 2). 


Since 0 < qmiri ^C)) < |, we can conclude: 

qmin(P(f)) . 1 


cot 


" sin 


= O 


1 


Therefore 

Finally, since 
we conclude: 


|S(/,I(2,n,*))|=0 P(P(/)) + 


qmin(P(f))J ' 

1 


qmin(P(f))J ' 
V(P(f))+V(P'(f)) = 0(n), 


|S(/,X(2,n,*))| = O (min (n,P(P(/)) 


1 


qmin(P(f)) 


Example 14. Consider a function f £ T(2,12, *) (see Fig. [^). T/ie gray set is AP(/). 
XTie black stars are the points from Vert(P(/)) and the white stars are the points from 

AP(/) fl M 0 (f). 

Proposition 15. Pet / G T(2,n, *) and M\(f) > 1. TTien f is a \Vert(P(f))\-threshold 
function and the sets of essential points of f with respect to T(2,n, *) and with respect 
to A(2,n, |Vert(P(/))| + 1) coincide. 

Proof. Lemma [h] shows that functions / with |Vert(P(/))| = 2 are 2-threshold. Let 
|Vert(P(/))| > 2. The polygon P(/) is a solution of a system of |Vert(P(/))| inequalities, 
and therefore / is a |Vert(P(/))|-threshold. For any x £ Vert(P(/)) we can add one 
inequality to the system ([!]) to get a function /' £ ‘1(2, n, |Vert(P(/))| + 1) such that 
Mr(/') = Af!(/) \ {4, hence Vert(P(/)) C S(/,T(2,n, |Vert(P(/))| + 1). 

Now, consider an arbitrary point x £ D(f ) and a function /' £ T(2,n, *) with 
M\(f) = Conv(P(/) U {a;}) H Obviously, |Vert(P(/'))| < |Vert(P(/))| + 1 and /' is 
a (|Vert(P(/))| + l)-threshold function. The functions / and /' differ in the unique 
point x and belong to the classes of |Vert(P(/'))|-threshold and (|Vert(P(/))| + 1)- 
threshold functions, respectively. Therefore x £ S(f, A(2, n, |Vert(P(/))| + 1)) and 
D(f) C 5(/4(2,n,|Vert(P(/))| + 1)). According to Theorem 8] the sets of essential 
points of / with respect to X(2 ,n,*) and with respect to X(2,n, Vert(P(/))| + 1) coin¬ 
cide. ■ 
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Figure 3: P(f) (bold solid triangle), P'(f) (dashed triangle) and P" (dotted triangle) 
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Figure 4: The gray set is AP(/), the stripped area is P(f), and the union of both of them is P'(f) 








Example 16. Consider a function f £ 1(2, n, 4) with M\(f) = {(1,1), (1,2), (2,1)} (see 
Fig. We have Vert(P(/)) = {(1,1), (1, 2), (2,1)} and f is a 3-threshold function. Fur¬ 
ther, AP{f)rE% = {(0,0), (1,0), (2, 0), (3, 0), (0,1), (3, 1), (0, 2), (2,2), (3,2), (0, 3), (1, 3)}, 
and hence S(f, 1(2, n, *)) = E\ \ { (3, 2), (2,3), (3,3)} = S(f, T(2, n, 4)). 


3.3. The teaching set of functions from 1(2, n, 2) with a unique defining set of threshold 
functions 

In this section we consider the subset of 2-threshold functions over E 2 , for which the 
cardinality of minimal teaching set can be bounded by a constant. Also we show that 
for such 2-threshold functions the number of minimal teaching sets can grow as fl(n 2 ). 

Let / € T(2, n) and let a 0 , aq, a 2 be real numbers which are not all zero. We call the 
line aiXi + 02 X 2 = an i-separation line (or just separation line ) of / if there exists 
i £ {0,1} such that 


x = (Xi,X2 ) £ Mi(f) •£=>• a\X\ + a 2 X 2 < a 0 . 

For example, the equality corresponding to a threshold inequality of / defines a 1- 
separation line of /. Let us prove some properties of separation lines of threshold func¬ 
tions. 

It is known [IT] that \S(g)\ £ {3,4} and |5i(gf)|, |S'o(<?)| € {1,2} for any g £ T(2 ,n) 
and the 1-valued essential points of g are adjacent vertices of P(g). 

Proposition 17. Let f £ 1(2, n). For any i £ {0,1} there exists an i-separation line of 
f which contains all points of Si(f). 

Proof. Clearly, it is enough to prove the proposition for i = 1. Denote by l some 
1-separation line of / which does not contain integer points and let x £ Si(f). There 
exists a function g £ 1(2, n) such that x distinguishes / from g , that is f(y) = g(y) for 
all y £ E 2 \ {x} and g(x) = 0. Denote by l' some 1-separation line for g which also 
does not contain integer points. If l and l' are parallel lines then x lies between them. 
In this case we can pass through x a parallel to l and l' straight line l" which will be a 
1-separate line of /. If l and l' intersect in some point y , then the straight line l" which 
intersects x and y is a 1-separation line of /. Thus, for any essential point there exists 
a separation line which intersects x and does not contain any other integer points. This 
proves the proposition for ,Sj (/) = 1. 

Now let |Si(/)| = 2 and S\(f) = {x,y}. There exist functions g x ,g y £ 1(2, n) such 
that f(z) = gj(z ) for all z £ E%\ {j} and gj(j) = 0, where j £ {x,y}. Denote by 
lj a 1-separation line for gj which does not contain integer points except point j. By 
construction, sets M 0 (g x )nM 0 (g y ) and Mi(g x )r\Mi(g y ) are separated by the straight line 
l 1 containing x and y. Since M 0 (g x )r\M 0 (g y ) = M 0 (f ) and Mi(g x )C\Mi(g y ) = Mi(f)\l ', 
the line l' is a 1-separation line. ■ 

Proposition 18. Let f £ 1(2, n) and l is an i-separation line for f for some i £ {0,1}. 
Then Vert(Conv(Z fl E 2 )) C S}(/). 

Proof. Assume without loss of generality that i = 1 and l is a 1-separation line. If 
ICEl = 0, then the proposition is obvious. Suppose lCEf l = {x}, that is l intersects Ef 
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in exactly one point x. It is easy to see that l is also a O-separation line for a function 
g £ 1(2, n) which coincides with / on E\ \ {x} and g(x) = 0, therefore x is an essential 
point for /. Since l is a 1-separation line for / and x £ l, we conclude that x £ Si(f). 

Now suppose that |ini£^| > 1 and Vert(Conv(7n£^)) = {x, y}. We can turn l around 
i on a small angle (to not intersect any other integer points) in such a direction that 
y would be on the same halfspace from the line as other points of M\(f). New line V 
will be 1-separation line for / containing exactly one integer point x, and, as we showed 
above, x £ S\(f). The same arguments are true for y , that is y £ S\(f). m 

Proposition 19. Let f £ 1(2, n). The sets So(f) and Si (/) belong to the parallel 
separation lines and there is no integer points between the lines. 

Proof. Assume without loss of generality that |Si(/)| = 2 and Si(f) = {x,y}. By 
proposition |17| the line l containing S±(f) is a 1-separation line for /. We can make a 
translation of l in direction to Mo(/) to the closest line l 1 which intersects at least one 
point from M 0 (f). If |So(/)| = 1 and S 0 (f) = {z}, then z £ l' and the proposition holds. 
Let |So(/)| = 2 and So(f) = {z, u}. Note that triangles A xyz and A xyu contain no 
other integer points, except the vertices and the points on the segment xy. By the Pick’s 
formula both triangles have the same area. It means that both z and u are at the same 
distance from l and lie on the line V . ■ 

Theorem 20. Let f £ 1(2, n, 2) and M\(f ) n I3(Conv(£{})) ^ 0, and let some set of 
threshold functions {/i, f 2 } defining f satisfies the following system: 

(S(fi) n M 0 (/ 2 ) = 0; 

|5(/ 2 )nM 0 (/i) =0. 

Then {/i, / 2 } is a unique defining set of f and 

a(f,1(2,n,2))<9. 

Proof. Note that 

B(Couv(E^)) = {x £ E% : x± = 0 V x 2 = 0 V x\ = n — 1 V x 2 = n — 1}. 

We consider two cases depending on the cardinalities of So(fi), *S'o(/ 2 )- 

Let |So(/i)| = 1 for some i £ {1,2}. Assume, without loss of generality, that 
|So(/i)| = 1, that is S 0 (fi) = {it}. Then |S'i(/i)| = 2 and ^(/i) = {t>i,u 2 }. Con¬ 
sider an arbitrary function /' £ 1(2, n, 2) which agrees with / on 5(/i) U 5(/ 2 ) and some 
of its defining set of threshold functions F' = {/-(, f^}- From the first equation of the 
system © it follows that fi(x) = f(x) = f(x) for every x £ S(f±). Hence one of the 
functions from F' , say /{, should take the value 0 on it and the value 1 on iq and i >2 , 
therefore 

f[=h- (4) 

From the second equation of the system ([3]) we have / 2 (x) = f(x) = f(x) for every 
x £ S(f 2 ). This together with 0 imply that f! 2 agrees with f 2 on S(f 2 ), and therefore 
f 2 = f 2 . We showed that {/i,/ 2 } = F' , and hence f coincides with / and {/i,/ 2 } is 
a unique defining set for /. Moreover, S(fi) U S(f 2 ) is a teaching set of / and |5(/i) U 
S(fo.) | < 7. 
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Now suppose that |5 0 (/i)| = |5 0 (/ 2 )| = 2 , that is S Q (fi) = {ui,w 2 }, S 0 (f 2 ) = 
{vi,v 2 }. Denote by G C T(2, n,2) a set of 2-threshold functions, which agree with / 
on S(fi) U S(f 2 ). From the conditions of the theorem it follows that So(fi) £ Mi(fj) 
for i 7 ^ j. Note that So(/i) U So(f 2 ) is a set of vertices of a convex quadrilateral P = 
(ui,U2, vi,V2), and for each of the threshold functions {fi, f2} vertices from its teaching 
set are neighboring (see Fig. [ 6 ]). This implies that G is the union of two sets: 

Gi = {g | g £ G,3g 1 ,g 2 £ T(2,n) : g = gi/\g 2 ,{ui,u 2 } C M 0 (g 1 ), and {vi,u 2 } C M 0 {g 2 )} 

and 


G 2 = {g | g £ G, 3gi,g 2 £ T(2 ,n) : g = giAg 2 ,{ui,v 2 } C M 0 (g 1 ), and {u 2 ,ui} C M 0 (ff 2 )}. 


Applying the same arguments as in the previous case where |So(/»)| = 1 it can be shown 
that Gi = {/}. Now, to prove the uniqueness of a defining set of / it is sufficient to 
demonstrate that / ^ G 2 . To this end, we first show that 


Mi(f) H J Mi(g) C Int(P). 

0GG2 


(5) 


By Proposition 17 the line l containing u\,u 2 and the line l 1 containing v\,v 2 are a 
O-separation lines of /, and hence all points of Mi (/) lie between l and Note that 
for every threshold function h the sets Conv(Mi(/i)) and Conv(Mo(/i)) do not intersect. 
These facts imply that M\{f) n Mi(g) should lie between l and l 1 and between the 
segments u\v 2 and u 2 v 1 , which proves ([5|. Now it follows from ([ 5 ]) and the condition of 
the theorem that / ^ G 2 and {/ 1 , f 2 } is a unique defining set of /. 

Finally, we are interested in a point x' £ which would distinguish / from every 
function in G 2) that is f(x') 7 ^ g(x') for all g £ G 2 . By ([ 5 ]) we have g{x) = 0 for all g £ G 2 
and x £ Mi(/) \ Int(P). Since B(Comr(E^)) n Int(P) = 0 7 ^ P(Conv(P^)) n we 

can take an arbitrary point from P(Conv(P^)) n Mi(/) as x' and obtain a teaching set 
T for / which is equal to S(fi) U S(f 2 ) U {x'}. Note that any such a teaching set T is 
minimal and |T| < 9. 


Remark 21. 


Theorem 20 also holds when the domain is a convex subset of E 


2 

n' 


Corollary 22. Let f £ l X(2, n, 2) and there is a unique set of threshold functions {/1 , f 2 } 
defining f. If M\(f) D P(Conv(P^)) 7 ^ 0, then 


a(/,X(2,n,2))<9. 

Proof. By Proposition [3j for /1 and f 2 the following is true: 

f S(fi) n Mo(/ 2 ) = 0; 

\S(/ 2 )nMo(/r) = 0 . 

Therefore / satisfies the conditions of Theorem [20j ■ 

Recall that J(f, C) denotes the number of minimal teaching sets of a function / with 
respect to a class C. Using the set of functions G 2 from Theorem [20] the next lemma 
proves that number of minimal teaching sets of 2 -threshold functions can grow as U(?r 2 ). 
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Figure 6: The dashed and dotted lines correspond to pair of different functions from G 2 , and the solid 
lines correspond to the function /. 
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Lemma 23. 


max J(f, T(2,n, 2)) = fl(n 2 ). 

/eX(2,n,2) 


Proof. Let 


to = m(n) 



For n > 21 let /£ ‘1(2, n, 2) be defined by threshold functions /and /^ with 
the corresponding inequalities: 


—3a;i — 4^2 < —25, 

3x\ + 4x2 < 12 to — 1 . 

(n) 

Note that l : 3x\ + 4 x ’2 = 12m — 1 is a 1-separation line of /} and by Proposition 


and contains at least two integer points from E Therefore Conv(7 D E „) is a segment 
and its vertices are solutions of the following two integer linear programming problems 
with constraints n £ Z, n > 21 and to = : 
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we have Vert(Conv(Z n E ^)) C l) ). By construction, l is not parallel to x 2 -axis 


maxxi, 

3xi + 4x2 = 12 to — 1, 
0 < x\ < n — 1 , 

0 < X 2 < n — 1 , 

X\,X2 £ Z, 


mmii, 

3xq + 4x2 = 12 to — 1, 
< 0 < xi < n — 1 , 

0 < X 2 < n — 1, 

Xi,X 2 £ Z. 


It is easy to check that the solutions of the above problems are (4 to — 3,2) and 
(1,3m — 1), therefore = {(4 m — 3, 2), (1,3m — 1)}. 

Now, the closest parallel to l line, which contains 0-values of /, is V : 3 xi+ 4 x 2 = 12to. 
By Proposition 19 all points of So(f 2 ) are vertices of Conv(7'ri-E^), and to find So(f 2 n ' 1 ) 
we can use the same arguments as we did for The same is true for /}"■* and the 

set S(fi^), hence the final conclusion looks as follows: 


So(A n) ) = {tii = (8,0), u 2 = (0,6)}, 

5i(/ 1 (n) ) = {ti 3 = (7,l),ti4 = (3,4)}, 

So(/ 2 (n) ) = {tti = (0,3 m),V 2 = (4to, 0)}, 
^i(f 2 n) ) = {ti3 = (4 to — 3,2), V4 = (1,3 to- 1)}. 


Note that /^ satisfies the conditions of Corollary [ 22 ] and Theorem 20 and quadrilateral 
P from the proof of Theorem 20 has vertices tq, u 2 , tq, and v 2 . Denote by G C T(2, n, 2) 
the set of functions such that for every g £ G and for some threshold functions 51,52 
defining 5 the following is true: 


Si(/ 1 (n) )USi(/ 2 C " } )CM 1 (5), 


{ui,v 2 } C M 0 ( 51 ), 
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{m 2 ,Wi} c M 0 (g 2 ). 

The set G corresponds to the set G 2 from the proof of Theorem[20| therefore all functions 
from G and only them agree with on S(f[ n ^) U Let us bound from below 

the number of points x' such that 

f( n \x') ^ g{x') for all g £ G. (6) 

Denote by R(n) the triangle with vertices V3, 114 and (n — l,n — 1) and by L(n ) the 
segment V 3 V 4 . It is clear that R(n) fl = L(n) D E^- By construction of the 

set G , the inclusion R(n ) fl E\ C M\(g) holds for any g £ G. It means that any 
point from ( R(n) \ L(n )) D E% distinguishes /^ from any function in G. Therefore the 
number of minimal teaching sets for /*■"•* can be lower bounded by the cardinality of 
( R(n ) \ L(n)) fl E%, which is equal to \R(n) fl E\\ — \L(n) fl E%\. 

The number of integer points in L[n) can be calculated through the GCD of the 
differences between coordinates of V3 and V4: 

| L(n) n E 2 n \ = 2 + GCD((4to - 3) - 1, (3m - 1) - 2) = m + 1. 


The number of integer points in R(n) can be calculated by means of the Pick’s formula. 
Indeed, since R(n) is a triangle with integer vertices, we have 

5(I?(n)) = |Int( J R(n))| + ra^-l 


and therefore 


Now since 

and 


\R(n)GE 2 n \ = \lnt(R(n))\ + \B{R(n))\ =S(R(n)) + 

\B(R(n))\ > | L(n) D E 2 n \ + 1 > m + 2 
| (to — l)(12m — 7n + 6)| 


\B(R(n))\ 


+ 1 . 


S(R(n)) = 


we conclude that 


, . T , *-.< 2 1 . \(m - l)(12m — 7n + 6)1 m + 2 2 . 

|(i?(n) \ L(n )) H El\ > ^^+ 1 - (m + 1) = 0(n 2 ). 

That is the number of minimal teaching sets for the function /^ grows as fl(?r 2 ). 


4. Open problems 

In this paper, we investigated structural and quantitative properties of sets of essential 
points and minimal teaching sets of fc-threshold functions. 

We proved that a function in the class T (d, n, *) has a unique minimal teaching set 
which is equal to the set of essential points of this function with respect to the class. For 
a function in the class T(2, n, *) we estimated the cardinality of the set of essential points 
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Figure 7: An example of /( 24 ), the black points are the points of the gray shape is R(n), the 

stripped area is P(f). 
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of the function. It would be interesting to find analogous bounds on the cardinality of 
the set of essential points of a function in T (d, n, *) for d > 2. 

We considered T(2, n, 2) and proved that the set of essential points of a function in this 
class is not necessary a minimal teaching set. Moreover we showed that J(T(2,n, 2)) = 
fi(n 2 ). Also in the class T(2,n, 2) we identified functions with minimal teaching sets of 
cardinality at most 9. It would be interesting to estimate the proportion of functions 
with this property in the class T(2, n, 2). 
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